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b.  Research  Objectives 


(i)  Rational  Approximates 

The  topics  here  will  be  presented  in  a  concise  but  clear  manner  so  that 
the  reader  encounters  little  difficulty  in  understanding  the  context  and 
technical  merits.  Host  specifications  are  unrealizable  from  the  physical 
realizability  standpoint  and  have  to  be  approximated  with  respect  to  a  chosen 
error  criterion.  The  approximation  may  be  done  either  in  the  frequency  or 
spatial  domains.  It  was  recognized  that  the  quality  of  the  approximant  must 
be  coupled  to  the  facility  or  convenience  with  which  the  approximant  can  be 
calculated.  This  necessitated  the  demand  for  attention  to  the  scopes  for 
development  or  exploitation  of  fast  algorithms;  that  is,  an  understanding  of 
the  problem  structure  was  considered  crucial.  At  the  same  time,  the  approximation 
technique  was  required  to  be  fundamental  and  broad  enough  to  support  a  wide 
variety  of  applications.  It  was  decided  that  the  Pade  approximation  technique 
would  serve  as  an  ideal  nucleus  from  which  the  desired  research  directions  and 
objectives  could  ideally  be  reached. 

The  Pade  approximant  of  order  [L/M]  to  the  formal  power  series  t(z)  =* 

oo 

E  t^  z  is  the  rational  function  a^(z)/b(z),  where  a^Cz)  and  b^Cz)  are 

k_o 

polynomials  of  degree  at  most  L  and  M  respesctively  such  that 

*  aL  Z)  L+M+1* 

t(z)  -ITS)  ‘  0U  >  (1> 

M 

and  0(zL+^+^)  in  (1)  is  taken  to  mean  that  terms  of  any  order  less  than 
^L+M+l  are  missing.  An  approximant  of  any  order,  if  it  exists,  is  unique 
and  the  problem  of  computing  the  approximant  essentially  consists  of  solving 


a  system  of  simultaneous  linear  equations 


^  ^bM  bM-l  '  ’  '  bJ  =  ^L+l  \ 


'  *  CL+M^  (2) 


where,  is  a  (M  x  M)  Hankel  matrix  obtained  by  setting  [t^^^  CL-Mf2  "  ’ 
■»  t 

tLl  as  the  first  row  and  [tL  t^+1  ...  as  the  last  column, 


b,  's  in  (2)  are  coefficients  of  polynomial  bu(z)  and  ’  t'  denotes  the  transpose 

of  a  matrix.  It  is  well  known,  however,  that  equations  of  the  type  in  (2)  occur 

in  the  problem  of  partial  realization  of  systems  from  prescribed  input-output 

2 

maps  [1].  Recursive  0(n  )  algorithms  which  exploit  the  Hankel  structure  of 
the  matrix  H^,  to  solve  for  the  system  of  equations  (2)  have  been  proposed  [2]. 
It  has  also  been  noted  recently  [3]  that  these  recursions  fall  under  the  class 
of  re curs ions known  as  Lanczos  recursions  [4  J.  Furthermore,  the  same  recurrence 
formula  occurs  in  the  entirely  different  context  of  shift-register  synthesis 
and  is  called  the  Berlekamp-Massey  relation  [5].  One  objective  of  the  research 
was  to  develop  a  scheme  for  recursive  computation  of  the  Padd  approximants , 
when  the  coefficients  of  the  power  series  t(z)  are  rectangular  matrices. 

A  closer  examination  of  the  recurrence  relations  (in  the  scalar  case) 
reveals  that  the  denominators  of  the  successive  members  of  the  sequence  of 
approximants  are  connected  by  a  three  term  recurrence  formula  similar  to  the 
one  followed  by  polynomials,  which  are  orthogonal  on  a  real  interval.  In  fact, 
it  has  been  shown  that,  under  some  restrictive  hypothesis,  the  sequence  of 
polynomials  {z  b^(z  )  >M_^ssociated  with  the  denominators  of  the  sequence 

CO 

{ KM"k)/M]}M_Q  indeed  form  a  set  of  orthogonal  polynomials  of  the  type  just  men¬ 
tioned.  Furthermore,  the  sequence  of  successive  convergents  of  a  continued 
fraction  expansion  of  a  special  type  associated  with  t(z)  is  known  to  be  the 
same  as  the  sequence  of  Padd  approximants:  [0/1),  [1/0],  [1/1],  [2/1],  [2/2], 

.  .  .  to  t(z). 

Also,  the  infinite  series  t(z)  is  known  to  be  a  Stieltjes  series  if  certain 
positive  definiteness  conditions  on  the  Hankel  matrices  in  (2)  are  satisfied. 
A  result  of  significant  interest  in  the  context  of  this  discussion  is  that 
the  sequence  of  Pade  approximants  of  certain  orders  to  a  Stieltjes  series  can 
be  shown  to  be  realizable  driving  point  impedance  functions  of  electrical 
networks  consisting  of  two  types  (RC,  RL,  or  LC)  of  elements.  Proof  for  this 
fact  can  be  given  by  classical  ladder  type  synthesis  techniques  or  via  a 
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consideration  of  the  Cauchy  index  of  rational  functions  of  one  variable. 

Another  objective  of  the  research  was  to  investigate  into  the  properties 
of  the  "denominator"  polynomial  matrices  with  respect  to  any  recurrence 
relation  they  might  obey.  The  Stieltjes  series  was  planned  for  study  in  a 
matrlk  setting,  especially  with  the  objective  of  exploring  into  possible 
links  of  the  approximants  to  multiport  network  theory.  The  theory  of  matrix 
polynomials,  orthogonal  over  a  real  interval,  was  then  natural  to  investigate, 
especially  with  the  possible  availability  of  any  physical  insight  from  network 
theory. 

In  view  of  the  established  importance  of  2-D  systems  theory  from  both 
theoretical  and  applications  standpoints,  the  next  objective  was  to  attempt 
to  extend  the  Pade  approximation  scheme  to  the  2-D  case  by  requiring  the  rational 
approximant  of  prescribed  degree  t(z^,z2)  to  be  such  that  R  in  (3)  is 
zero  over  a 

t^,  z2)  -  t(zlt  z2)  =  ?  ?  R_  z*  z\  (3) 

finite  set  of  points  (i,j)  having  a  chosen  geometry  in  the  two-dimensional 
lattice.  Two  different  geometries  have  been  considered  in  [6]  and  [7]. 

Numerous  other  possibilities,  in  this  direction  of  generalization  exists  with 
respect  to  choice  of  geometry  of  these  lattice  points  and  it  is  to  be  expected 
that  the  approximants  resulting  from  considerations  of  various  geometries 
will  have  properties  desirable  in  the  synthesis  of  two-dimensional  systems. 

An  important  objective  of  the  research  was  to  investigate  into  the  structure 
and  properties  of  these  2-D  rational  approximants,  in  addition  to  providing 
fast  methods  for  their  computation. 

The  approximants  are  required  to  satisfy  certain  desirable  properties, 
when  used  to  design  complex  systems.  TWo  such  properties  are  stability  and 
robus tness  to  parameter  variations.  Another  objective  of  the  research  was 
to  provide  suitable  means  for  incorporating  these  desirable  features  in  the 


approximan  ts. 
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The  final  objective  in  the  approximation  phase  of  the  research  was  to 
investigate  into  the  conditions  on  the  coefficients  of  the  rational  approximants 
so  that  certain  desirable  properties  like  maximal  flatness  or  equiripple  behavior 
in  the  frequency  response  of  the  designed  multidimensional  filters  would  be 
obtained. 

ii.  Multidimensional  Signal  Processing  Over  a  Finite  Field 

The  theory  for  1-D  discrete  systems  which  are  linear  over  the  finite 
field  of  two  elements  (binary  field),  GF(2),  is  well  established.  One¬ 
dimensional  discrete  systems  which  are  linear  with  respect  to  the  finite  field 
of  two  elements,  0  and  1,  have  been  developed  for  applications  such  as 
generation  of  pseudorandom  sequence  and  error-correcting  codes.  Such  systems 
are  characterized  by  rational  functions  and  polynomials  in  one  variable  with 
coefficients  over  GF(2).  Recently,  the  need  for  study  of  properties  of  two 
variable  rational  functions  in  the  quotient  field  of  the  ring  of  bivariate 
polynomials  with  coefficients  belonging  to  GF(q),  has  been  felt  in  the  synthesis 
of  psuedornadom  noise  arrays  that  exhibit  special  correlation  properties, 
system  identification,  and  two  dimensional  filtering  over  a  finite  field. 

There  is  no  satisfactory  definition  for  primitivity  of  2-D  polynomials  over 
a  finite  field,  though  that  concept  has  played  a  vital  role  in  the  1-D  case 
especially  in  error-correcting  code  construction  and  generation  of  maximum 
length  shift  register  sequences,  which  in  turn  are  ideally  suited  for  the 
identification  of  linear  systems  using  cross-correlation  techniques.  For 
bivariate  polynomials,  the  study  of  primitivity,  the  generation  and  enumeration 
of  irreducible  polynomials,  the  study  of  their  corresponding  array  and  their 
autocorrelation  properties  was,  therefore,  considered  to  be  potentially  very 
useful.  An  added  advantage  to  this  study,  is  the  observation  of  the  fact  that 
there  is  much  in  common  between  the  algebraic  structure  that  characterize 
these  and  the  approximation  problem  discussed  earlier. 
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Research  in  this  area  was  considered  to  be  very  fundamental  to  the  general 
theme  of  research  conducted. 

The  need  for  factoring  a  given  polynomial  matrix  A(z)  in  the  form  A(z)  = 

A^(z)  k^(.z)  (where  the  polynomial  matrix  factors  A^(z)  and  A^Cz),  besides 
having  elements  in  the  same  ring  to  which  the  elements  of  A(z)  belong,  might 
also  be  required  to  satisfy  certain  special  properties),  occurs  in  many  situations 
These  include  network  theory,  filtering  of  multiple  time  series,  system  theory, 
damped  vibrations,  transport  theory,  and  Wiener-Hopf  equations.  Special  atten¬ 
tion  to  spectral  factorizations,  where  A^(z)  and  A^(z)  have  their  spectra  located 
one  inside  and  the  other  outside  a  Cauchy  contour  with  A(z)  analytic  on  a  neigh¬ 
borhood  of  the  contour,  has  been  given  in  [8].  A  more  general  type  of  factori¬ 
zation  theory  occurs  in  the  polynomial  matrix  approach  to  realization  theory  of 
linear  systems  [9],  which,  incidentally,  has  close  links  to  the  state-space  reali¬ 
zation  theory  [10].  A  state-space  realization,  S(z)  =  H(zl-F)  of  a  matrix  of 
strictly  proper  rational  functions  has  minimal  dimension  if  and  only  if  (F,G)  is 
controllable  and  (F,H)  is  observable.  On  the  other  hand,  a  polynomial  realization 

S(z)  =  W(z)  +  V(z)  [T(z)]"1  U(z) 

is  irreducible  if  T(z),  U(z)  are  relatively  left  prime  and  T(z),  V(z)  are  rela¬ 
tively  right  prime.  The  connection  is  provided  by  a  theorem  of  Rosenbrock  which 
states  that  a  pair  of  constant  matrices  (F,G)  is  controllable  if  and  only  if 
the  pair  zl  -  F,  G  of  polynomial  matrices  is  relatively  left  prime. 

Recent  developments  in  multidimensional  systems  theory  [11],  [12],  motivated 
by  a  variety  of  practical  applications  [13]  necessitated  investigations  of  the 
scopes  for  extension  of  the  univariate  (1-D)  multivariable  (or  multi-input  multi¬ 
output)  results  of  Rosenbrock  and  others  to  the  n-D  (n  >  1)  case.  The  realization 
theory  based  on  the  1-D  polynomial  matrix  approach  is  valid  for  polynomial  matri¬ 
ces  (generated,  for  example,  from  an  initial  non-irreducible  realization  of  S(z)) 
with  elements  from  an  arbitrary  principal  ideal  domain  and  when  the  solution 
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(say,  an  irreducible  realization)  is  to  be  constructed,  the  domain  is  further 
required  to  be  Euclidean.  In  n-D  (n  >  1)  system  theory,  this  is  not  the  case. 

In  [14],  Morf,  Levy  and  Kung  showed  how  the  greatest  common  right  divisor  (gcrd) 
could  be  extracted  from  two  specified  bivariate  polynomial  matrices  based  on 
their  primitive  factorization  theorem.  The  operations  necessary  to  implement 
the  extraction  scheme,  however,  required  the  ground  field  to  be  algebraically 
closed.  Subsequently,  Youla  and  Gnavi  [15]  showed  the  infeasibility,  in  general, 
of  primitive  factorization  for  polynomial  matrices  in  three  variables  and  among 
other  interesting  results  also  presented  a  primitive  factorization  algorithm 
for  2-D  polynomial  matrices  similar  to  the  one  in  [7].  This  algorithm  also 
requires  the  ground  field  to  be  algebraically  closed.  This  requirement  is  not 
satisfied  in  many  problemsof  practical  interest.  In  continuous  linear  system 
theory,  the  ground  field  is  usually  real,  while  in  the  discrete  case  it  could 
also  be  finite  [13,  ch.  6].  With  the  objective  of  increasing  considerably  the 
scope  for  application  of  the  important  theoretical  results  in  [14],  [15],  the 
question  as  to  whether  or  not  the  primitive  factorization  theorem,  presented 
in  [14,],  holds  over  any  arbitrary,  but  fixed,  field  of  coefficients  was  posed 
in  [13].  A  very  important  objective  of  the  research  was  to  obtain  an  answer 
to  the  question  posed  and  explore  the  impact  of  the  result  to  various  applications 
of  interest  to  the  Air  Force. 
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c.  Status  of  the  Research 

(i)  Rational  Approximants 

Let  K[z]  be  the  set  of  formal  power  series  over  a  ring  K  with  indeterminate 
z.  In  the  present  context,  K  will  be  the  ring  of  constant  rectangular 
matrices  of  order  m  x  n,  whose  elements  do  not  necessarily  commute..  The 
matrix  Pade  approximation  problem  then  consists  of  finding  two  matrix 
polynomials  A^(z)  and  B^(z)  such  that  for  a  given  T(z’v  c  K[z]: 

(1)  6[A^(z)]  <_  L,  6[B^(z)j  M,  where  "6"  denotes  "degree" 

(2)  the  residual, 

R(z)  =  T(z)  Bm(z)  -  A^z) 
satis  fies 

ord  R(z)  >_  M  +  L  +  1 

In  the  conventional  scalar  Pade  theory,  for  A^(z)  and  B^fz)  to  be  devoid 

of  a  common  divisor  of  degree  greater  than  zero,  it  is  necessary  that 

B  (0)  be  nonzero.  In  the  case  considered  here,  Bw(0)  is  taken  to  be 
M  M 

nonsingula*"  and  wirho-'t  loss  of  generality  it  may  be  set  equal  to  the 
identity  matrix  I  of  appropriate  order. 

B„(0)  -  I 

A^(z)  B^  l(.)  will  then  denote  the  right  matrix  Pade  approximant 
of  order  [L/M].  The  LMPA  (L  stands  for  left)  may  be  (RMPA)  analogously 
defined.  In  [c.l],  it  has  been  established  that  (except  possibly  in 
certain  derogatory  cases),  a  recurrence  relation  relates  the  [L+l/M+1], 
[L/M],  and  [L-l/M-1]  order  matrix  Pade  approximant®  (left  or  right),  the 
existence  of  which  is  guaranteed  from  the  vailidity  of  a  certain  rank 
condition  on  the  corresponding  set  of  characterizing  matrices  possessing 


a  block-IIanke  1  structure. 


The  preceding  results  have  been  used  to  define  and  study  a  special  type 
of  power  series  belonging  to  the  ring  of  constant  square  matrices.  The  main 
result  documented  in  [c.2]  is  the  proof  of  the  relationship  between  rational 
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aoproximanfs  of  appropriate  orders  to  a  specified  symmetric  matrix  power  series 
of  the  special  type  referred  to  and  mulitport  network  synthesis  using  the  matrix 
version  of  the  classical  continued  fraction  expansion  theory  and  the  recently 
developed  artifice  of  matrix  Cauchy  index  [c.3].  The  "denominator"  polynomial 
matrices  of  the  approximants  are  shown  to  form  an  orthogonal  polynomial  matrix 
sequence  over  a  real  semi-infinite  interval.  Though  mathematical  derivations 
of  the  properties  of  the  polynomial  matrices  belonging  to  the  orthogonal  poly¬ 
nomial  matrix  sequence  have  been  given,  the  reader  has  also  been  alerted  to 
the  feasibility  of  network-theoretic  justification  of  the  results.  It  is 
hoped  that  these  links  between  mathematical  results  and  the  theory  of  network 
realizability  will  kindle  interest  for  further  research  among  scientists  coming 
from  either  disciplines. 

The  mathematical  literature  [c.4],  [c.5],  contains  some  results  on  the 
extension  of  the  Padd  approximation  scheme  to  power  series  in  more  than  one 
indeterminate,  primarily  with  a  veiw  towards  applications  in  problems  of  physics 
and  numerical  analysis.  In  these  approaches,  however,  the  Hankel  nature  of 
the  characterizing  matrix  is  lost  and,  therefore,  the  feasibility  of  recursive 
computation  is  seriously  impaired.  In  the  contexts  of  two-dimensional  digital 
filtering,  stochastic  realization  and  image  processing,  the  speed  of  computa¬ 
tion  is  crucial.  In  order  to  conform  to  this  requirement,  the  questions  of 
existence,  nonuniqueness  alongwith  scopes  for  recursive  computation  when 
existence  is  guaranteed,  are  investigated  in  depth  in  [c.6].  In  [c.6],  attention 
is  directed  to  the  exploitation  of  a  block  Hankel-Hankel  matrix  structure 
(where  the  elements  of  the  block  may  also  be  viewed  as  block-Hankel  matrices) 
that  can  be  used  to  characterize  the  problem.  A  sequence  of  vertical  and 
horizontal  Pade  approximants  over  the  chosen  "Hankel  matching  grid"  are  defined. 
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A  three-term  recurrence  formula  is  developed  to  compute,  first,  all  the  vertical 
approximants  of  a  prescribed  order,  in  the  sequence.  In  physical  problems,  the 
rational  approximants  are  required  to  be  stable.  A  sufficient  condition  for 
BIBO  stability  based  on  the  zero  distribution  of  a  bivariate  polynomial, 
obtained  directly  via  computation  of  the  determinant  of  a  matrix  formed  from 
the  input  data,  augmented  by  a  row  of  matrix  inde terminates,  has  been  obtained 
in  [c.7].  Thus,  if  one  is  willing  to  invest  one's  time  in  the  computation  of 
the  determinant  of  a  specified  matrix  followed  by  a  check  for  stability  of  one 
bivariate  polynomial  (the  determinant  computed),  the  effort  required  to  actually 
calculate  an  approximant,  which  will  turn  out  to  be  unstable,  may  be  saved. 

For  generalization  of  the  concept  of  Pade  approximants  to  nonlinear  operators 
and  its  scopes  for  tackling  nonlinear  systems  of  equations,  nonlinear  initial 
and  boundary  value  problems,  nonlinear  partial  differential  equations  and 
nonlinear  integral  equations,  a  recent  dissertation  [c.8]  is  of  interest. 

Since  1-D  techniques  for  computing  Pade  approximants  are  more  well  developed 
and  naturally,  faster,  the  feasibility  of  constructing  2-D  rational  approximants 
to  match  exactly  a  prescribed  set  of  coefficients  in  a  double  power  series,  by 
using  only  the  1-D  Pade  technique  has  been  explored  in  [c.9].  The  matching  grid 
is  not  restricted  to  a  rectangular  grid  though  for  brevity  in  exposition  this 
type  of  grid  is  focussed  upon  in  [c.9].  There,  it  is  shown  that  it  is  possible 
to  obtain  a  2-D  rational  approximant  by  computing  several  1-D  Pade  approximants 
over  power  series  coefficients  that  belong  to  a  field  and  only  one  1-D  Pade 
approximant  over  power  series  coefficients  that  belong  to  the  field  of  rational 
functions  in  1  indeterminate.  The  procedure  and  basic  philosophy  extends  easily 
to  the  n-D  case,  n  >  2.  The  speed  and  flexibility  in  implementation  of  the 
scheme  is  likely  to  be  useful  in  various  types  of  filter  design  problems. 
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Positivity  and  Stability 

Positivity  and  stability  results,  which  are  fundamental  in  the  area  of 
multidimensional  systems  design  were  established  on  firm  foundations.  It  has 
already  been  pointed  out  that  rational  approximants  are  useless  for  implementa¬ 
tion,  if  unstable.  A  new  stability  test  for  n-D  digital  filters  has  been  obtained 
in  [c.10].  This  test  dwells  on  a  conceptually  different  philosophy  than  other 
algebraic  tests  advanced  for  multidimensional  filters,  as  noted  in  [c.ll],  though 
the  computational  advantages  in  implementation  may  not  be  present,  in  general. 

The  problem  of  testing  a  polynomial  for  zeros  on  a  polydisc  distinguished 
boundary  is  considered  in[c,12].  Such  tests  are  required  in  testing  a  linear 
discrete  shift-invariant  processor  for  exponential  stability  [c.13]  and  in 
theuse  of  ceptral  techniques  [c.14],  the  discrete  Hilbert  transform  and 
homomorphic  filtering.  The  test  procedures  for  stability  often  dwell  on  the 
checking  of  a  multivariate  polynomial  for  local  or  global  positivity.  It  is 
shown  in  [c.15]  that  certain  singular  cases  occurring  in  the  test  of  a  multi¬ 
variate  polynomial  for  global  positivity  need  not  be  considered,  leading  to 
a  considerable  improvement  in  the  efficiency  in  implementation  of  the  test 
procedure. 

Rob us tness 

In  problems  originating  from  physical  systems,  the  multivariate  polynomials 
characterizing  some  properties  of  the  system  under  study,  like  stability  or 
existence  of  limit  cycles,  might  not  have  integer  coefficients  and  might  even 
possess  coefficients  which  could  take  arbitrary  values  over  specified  intervals. 

In  such  cases,  it  is  useful  to  know  the  allowable  interval  within  which  the 
coefficients  might  fluctuate  centered  around  their  respective  unperturbed 
values,  so  that  the  test  implemen ted  on  the  polynomial  with  these  unperturbed 
coefficient  values,  if  found  to  yield  the  positivity  property  will  guarantee 
invariance  of  the  positivity  property  under  perturbation  of  any  or  all  of  the 


16 


coefficients  within  the  allowable  interval.  In  [c.16],  it  is  first  shown 
how  the  largest  symmetric  interval  centered  around  each  coefficient  of  a  globally 
positive  univariate  polynomial  may  be  determined  so  that  the  positivity 
property  is  invariant  under  any  perturbation  of  the  coefficients  within  that 
interval  (or  its  integer  multiple).  A  characterization  theorem  for  the  deter¬ 
mination  of  a  similar  interval  is  given  for  multivariate  polynomials  and  a 
scheme  for  finding  the  interval  via  recursive  computation  of  resultants,  allow¬ 
ing  the  elimination  of  at  least  one  indeterminate  at  each  step,  is  given.  This 
result  partially  contributers  towards  the  resolution  of  the  multidimensional 
filter  stability  problem  under  coefficient  fluctuation  in  the  characterizing 
denominator  polynomial  of  the  filter  due  to  any  sources  of  error  —  roundoff, 
quantization  etc.  In  [c.17],  the  main  goal  of  obtaining  conditions  for 
invariance  of  stability  properties  as  directly  as  possible  in  terms  of  the 
original  coefficients  (just  as  was  done  with  respect  to  the  global  positivity 
property  in  [c.16])  was  obtained  for  low  degree  polynomials.  Though,  higher 
degree  polynomials  are  not  tackled  in  [c.17],  the  results  should  be  useful 
from  the  practical  standpoint,  since  often  the  design  of  higher  order  systems 
is  based  on  the  design  of  low  order  blocks  or  prototypes. 

Stabilization 

Following  the  derivation  of  a  rational  approximant  and  implementation  of 
the  stability  test  a  filter  may  be  found  to  be  unstable.  A  practical  problem 
encountered,  then,  is  to  stabilize  the  filter  without  appreciable  change  in 
the  magnitude  of  the  frequency  response.  TWo  approaches  towards  the  attain¬ 
ment  of  this  goal  are  the  planar  least  squares  Inverse  (PLSI)  approach  and  the 
discrete  Hilbert  transform  (DHT)  approach.  In  [c.18]  it  is  shown  using  recent 
results  from  algebraic  computational  complexity  theory  that  the  multiplicative 
complexity  of  computation  of  a  2-D  DHT  fs  not  greater  than  twice  the  sum  of 
multiplicative  complexities  of  two  1-D  DHT's. 


An  important  fact  exploited  in  many  applications  (like  the  construction 
of  error  correcting  codes)  is  the  existence  of  irreducible  single  variable 
polynomials  of  any  specified  degree  whose  coefficients  belong  to  the  finite 
field,  GF(q)  (the  binary  field  case,  where  q=2 ,  is  of  greatest  practical 
significance).  In  [c.19],  a  nontrivial  extension  of  a  known  procedure  to 
obtain  the  number  of  distinct  irreducible  monic  univarate  polynomials  of 
prescribed  degree  m  with  coefficients  in  GF(q)  is  made  with  respect  to 
multivariate  polynomials.  Specifically,  a  procedure  is  given  to  determine  the 
number  of  distinct  irreducible  polynomials  of  prescribed  degree  in  each  of  the 
independent  variables  and  having  coefficients  in  GF(q) . 

In  [c.20],  an  analysis  of  the  structure  and  properties  of  the  impulse  response 
array  of  2-D  discrete  space  systems,  characterized  by  rational  functions 
having  coefficients  in  GF(q) ,  is  given.  It  is  shown  that  such  an  array  exhibits 
a  rwo  (column)  type  of  periodicity.  This  property  specializes  to  the  doubly 
periodic  property  if  and  only  if  the  denominator  polynomial  of  the  transfer 
function  is  separable  into  a  product  of  univariate  polynomials.  Arrays  with 
a  maximum  of  three  levels  in  the  autocorrelation  function  are  identified  and 
explicit  expressions  for  these  levels  are  given.  This  result  provides  the 
complete  characterization  of  arrays  which  are  remarkably  close  to  the  pseudo¬ 
random  arrays  sought  in  a  variety  of  applications  including  the  study  of 
spectrometric  imagers  and  sound  diffusion. 

( i i i )  Primitive  Factorization,  Coprimeness,  Matrix  Fraction  Description 

A  problem  of  importance  both  from  the  theoretical  and  application  viewpoints 
has  been  solved  during  the  course  of  this  research.  In  1977  and  1979,  algorithms 
were  presented  to  extract  in  some  sense  the  content  of  a  full  rank  matrix  A  with 
entries  in  the  ring  K[z,uj]  of  bivariate  polynomials  over  some  field  K.  However, 


18 


the  algorithms  presented  in  both  cases  specify  and  require  the  coefficient 
field  K  to  be  aJ gebraically  closed  -  typically  the  field  of  complex  numbers. 

It  is  desirable,  from  theoretical  and  computational  standpoints  to  have  no 
such  restriction  on  K;  so,  for  example,  one  could  do  the  factorization  over 
the  real  field  or  even  the  field  of  rational  numbers,  provided  the  coefficients 
start  out  in  these  field.  In  [c.21]  an  algorithm  which  produces  a  primitive 
factorization  over  an  arbitrary  field  K  is  presented.  Several  related  results 
leading  to  a  general  factorization  theorem  are  also  stated  and  proved. 
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10.  N.  K.  Bose,  "Finite  field  methods  in  multidimensional  systems  theory," 
invited  talk  in  a  Special  Session  on  Recent  Advances  in  Mathematical 
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Universitelt,  Amsterdam  on  June  21,  1982,  at  Department  of  Mathematics, 
Tcchnische  Hogeschool,  Eindhoven  on  June  23,  1982  and  at  Institute  of 
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of  Automatic  Control  and  Industrial  Electronics  at  ETH,  Zurich  on 
June  20,  1982. 

15.  N.  K.  Bose  "Bidiraensional  digital  filtering  over  a  finite  field  - 

latest  results,"  invited  seminars  at  Laboratory  on  Digital  Signal  Processing 
Swiss  Federal  Institute,  Lausanne,  on  June  25,  1982  and  at  Institute  of 
Automatic  Control  and  Industrial  Electronics,  ETH,  Zurich  on  June  29,  1982. 

16.  N.  K.  Bose  "Applications  of  2-D  systems  theory:  spatio-temporal  filtering 
over  finite  and  infinite  fields,"  invited  seminar  at  Department  of 
Mathematics,  Technische  Hogeschool,  Eindhoven  June  22,  1982. 

17.  N.  K.  Bose  was  invited  to  give  four  seminars  on  recent  results  in  multi¬ 
dimensional  systems  theory  including  "stabilization  of  two-dimensional 
feedback  systems  by  causal  and  weakly  causal  compensators,"  at  Department 
of  Electrical  Engineering,  University  of  Waterloo  on  July  12,  July  13, 

July  15  and  July  16,  1982. 
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1.  Regular  reviewer  for  Zentralblatt  fur  Mathematik  and  Mathematical  Reviews. 

2.  Regular  reviewer  of  papers  submitted  to  journals  including:  Proceedings  of 
IEEE,  IEEE  Transactions  on  ASSP,  CAS,  and  Automatic  Control,  Automatica, 

Int.  J.  on  Control,  J.  of  the  Franklin  Institute,  and  Canadian  Electrical 
Engineering  Journal. 

3.  Elected  to  be  Fellow  of  IEEE  for  contributions  to  multidimensional 
systems  theory  and  circuits  and  systems  education,  effective  January  1,  1981 

4.  Served  as  Associate  Editor,  IEEE  Transactions  on  Circuits  and  Systems 


between  June  1980  to  June  1981. 
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5.  Serving  as  Chairman  of  Education  Committee,  IEEE  Society  on  Circuits 
and  Systems,  since  1979. 

6.  Serving  as  member  of  steering  committee  on  Midwest  Symp.  on  Circuits  and 
Systems,  since  1969. 

7.  Invited  to  chair  a  Session  on  "Large-scale  dynamical  systems,"  at  the 
First  International  Conference  on  Circuits  and  Computers,  Port  Chester, 

New  York,  on  October  2,  1980. 

8.  Organized  a  Pre-Symposium  Workshop  on  "Applied  Multidimensional  Systems 
Theory,"  on  April  26,  1981  preceding  the  1981  International  Symposium  on 
Circuits  and  Systems,  held  at  Chicago,  Illinois  between  April  27,  1981  to 
April  29,  1981.  The  workshop  was  very  well  attended  by  participants,  both 
from  industries  and  universities,  and  was  considered  to  be  highly  successful. 

9.  Invited  to  participate  in  a  workshop  on  Rational  Approximations  for  Systems 
at  Leuven,  Belgium  on  August  31  -  September  1,  1981. 

10.  Invited  to  be  a  member  of  the  Program  Committee  of  the  European  Conference 
on  Circuit  Theory  and  Design  at  the  1981  European  Conference  on  Circuit 
Theory  and  Design,  held  at  the  Hague,  Netherlands,  August  25-28,  1981. 

11.  Invited  to  be  a  member  of  the  Technical  Program  Committee,  in  charge  of 
systems  at  the  International  Symposium  on  Circuits  and  Systems,  to  be 
held  at  Newport  Beach,  California,  May  2-4,  1983. 

12.  Reviewer  of  research  proposals  submitted  to  the  Engineering  Division  of 
National  Science  Foundation  on  August  1978,  June  1980,  and  July  1982. 

13.  Reviewer  of  proposal  submitted  to  the  Division  of  International  programs 
of  National  Science  Foundation  on  January  1980  (U .S . /Aust ralian  Joint 
Seminar/Workshop)  and  January  1983  (US-West  European  Cooperative  Science 
Programs) . 
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14.  Reviewer  of  research  proposal  submitted  to  the  Air  Force. 

15.  Invited  to  serve  on  the  Technical  Program  Consnittee  in  the  area  of  Multi¬ 
dimensional  Processing  at  the  forthcoming  International  Conference  on 

^Acoustics,  Speech  and  Signal  Processing  to  be  held  in  San  Diego,  California, 
March  19  -  21,  1984. 

16.  Invited  to  write  a  monograph  on  Recent  Advances  in  Multidimensional  System 
Theory  by  the  Managing- Editor ,  Professor  Dr.  M.  Hazewinkel  of  Mathematics 
and  Its  Applications,  D.  Reidel  Publishing  Company. 

17.  Invited  to  edit  a  Special  Issue  on  "Spatio-Temporal  Filtering,"  to  be 
published  by  Circuits,  Systems,  and  Signal  Processing,  Birkhauser  Boston  Inc. 


1.  The  Pade  type  of  rational  approximants  occur  in  the  problem  of  partial 
realization  of  systems  from  prescribed  input-output  map.  These  approximants 
are  .a Iso  known  to  be  closely  linked  to  Prony's  method,  whose  system  theoretic 
applications  include  its  use  in  the  identification  of  linear  dynamic  systens 
from  time-domain  measurements.  Apart  from  the  system  theoretic  relevance 

of  Pade  theory,  other  engineering  applications  include  time  domain  design  of 
digital  filters  and  order  reduction  of  control  systems.  In  the  problem  of 
digital  filter  design  the  coefficients  of  the  power  series  correspond  to  the 
impulse  response  sequence  of  the  filter.  The  problem,  then,  is  to  find  via 
the  Pade  method  a  realizable  transfer  function  or  matrix  (in  the  multivariable 
or  multivariable  bidimensional  cases,  which  have  been  the  prime  targets  in 
the  initial  stages  of  this  research)  from  a  finite  section  of  the  impulse 
response  characteristics.  In  the  context  of  order  reduction  of  control  systems, 
the  objective  is  to  find  a  transfer  function  or  matrix  of  lower  order  than 
the  original  transfer  function  or  matrix  such  that  the  suitable  predetermined 
number  of  Markov  parameters  of  the  lower  order  system  match  with  those  of 
the  original  one. 

2.  The  investigation  into  the  structure  and  properties  or  matrix  polynomials, 
orthogonal  over  a  real  interval,  has  been  considerably  illuminated  by  the 
physical  insights  offered  from  the  well  developed  theory  of  passive  linear 
multiport  network  synthesis,  to  which  the  mathematical  topic  is  shown  to  be 
closely  linked.  The  developed  topic  of  matrix  orthogonal  polynomials 

over  a  real  line  is  the  first  comprehensive  treatment  of  the  question  and  its 
subsequent  influence  in  multichannel  continuous  system  theory  (the  multi¬ 
channel  discrete  system  theory  and  matrix  orthogonal  polynomials  over  an 
unit  circle  were  topics  investigated  in  1978  by  researchers  in  U.S.A.  and 
Europe) . 
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3.  Since,  in  physical  problems,  an  approximant  is  required  to  be  stable, 
algebraic  tests  for  stability  were  fully  developed.  As  a  result,  these 
algebraic  tests  for  verifying  whether  or  not  a  multidimensional  linear  shift- 
invariant  filter  is  stable  are  now  well  established  and,  if  desired,  can  be 
implemented  with  infinite  precision,  provided  adequate  computational  resources 
are  available.  Recognizing  the  computational  chore  needed  to  test  for 
stability,  in  the  2-D  setting,  a  criterion  for  stability  of  a  2-D  matrix  rational 
approximant  over  a  Hankel  grid  was  developed,  based  on  the  input  data.  The 
criterion  yields  a  sufficient  condition  for  BIBO  stability. 

4.  Contributions  to  the  problem  of  stability  invariance  under  coefficient 
fluctuation  within  a  symmetric  interval  centered  around  their  original  values 
are  of  direct  interest  when  attempting  to  resolve  the  multidimensional  digital 
filter  stability  problem  under  coefficient  fluctuation  due  to  any  sources  of 
error- roundof f ,  quantization  etc,  as  well  as  in  the  study  of  linear  active 
analog  filter  stability  properties  when  the  objective  is  to  determine  the  allow¬ 
able  ranges  of  variation  of  one  or  more  parameters  (like  gains  of  op-amps 
imbedded  in  the  filter),  without  affecting  system  stability.  Therefore,  the 
foregoing  contributions  will  be  useful  in  the  incorporation  of  nonlinearity  in 
models  used  in  multidimensional  filter  stability  investigations. 

5.  The  results  obtained  on  the  zero-sets  of  multivariate  polynomials  in  non¬ 
compact  polydomains  will  find  use  in  multidimensional  discrete-continuous 
stability  investigations  including,  for  example,  the  study  of  asymptotic 
stability,  independent  of  delay,  in  differential  equations  of  the  neutral  type. 

6.  The  study  of  the  periodicity,  autocorrelation  and  crosscorrelation  properties 
of  the  matrix  impulse  response  sequence  associated  with  a  transfer  matrix  having 
coefficients  in  Z^,  and  obtained  results  on  means  to  construct  maximal  length 
matrix  impulse  response  sequences  via  application  of  feedback  on  the  state  model 
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constructed  from  the  specified  transfer  matrix  or  otherwise,  are  expected  to 
be  useful  for  simultaneous  ranging  to  several  targets,  multiple  terminal 
system  identification,  and  possibly  code-division  multiple  access  communication 
systems . 

7.  A  consequence  of  the  primitive  factorization  algorithm  developed  is  that 
the  gcd  extraction  algorithm,  general  factorization  theorem,  equivalence  of 
minor  and  factor  left  (or  right)  coprimeness  concepts  in  the  2-D  case  go 
through  with  no  restriction  on  the  coefficient  field  K. 

8.  The  primitive  factorization  theorem  enables  us  to  construct  the  desired 
factors  not  only  when  the  elements  of  a  given  matrix  are  in  D[w]  with  D  =  K[z] 
but  also  when  D  is  any  Euclidean  domain.  Let  Kc(z)  and  Kq(z)  denote, 
respectively,  the  rings  of  proper  real  rational  functions  and  stable  proper 
real  rational  functions.  Then,  a  rational  matrix  T(z,w)  of  order  m  x  H(m  <_  £) 
with  entries  in  Kc(z)(w)  or  Ka(z)(w)  has  a  matrix  fraction  description,  which 
after  the  application  of  the  primitive  factorization  theorem  can  be  written  in 
the  form, 

T(z,w)  =  T^  (z,w)  T2(z,w) 

where  the  matrices  T, (z,w),  T,(z,w)  each  have  entries  in  K  (z) [w]  or  K  (z)[w] 

i  2  co 

and  are  relatively  left  coprime  there.  It  may  be  possible  to  set  up  a  synthesis 
scheme  based  on  these  coprime  factors,  which  might  yield  a  realization  of  lower 
overall  dimension  in  the  dynamic  elements  z  and  w  than  is  feasible  via  Eising's 
method.'  It  is  of  interest  to  note  that  the  lossless  positive  real  property 
is  characterizable  by  the  factors  in  the  matrix  fraction  description  of  a  square 
transfer  matrix  with  entries  in  K(z),  where  K,  here,  is  the  field  of  real  numbers. 
With  the  availability  of  the  primitive  factorization  theorem  here,  it  may  be 
possible  to  extend  these  ideas  to  characterize  as  well  as  synthesize  2-D 
matrices  representing  various  types  of  systems  including  2-D  discrete  space 
systems  (causal  and  weakly  causal  as  well  as  differential  dealy  systems  and 
lumped-distributed  networks). 
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9.  The  following  result  has  been  proved:  A  multivariable  2-D  plant  P(z,w) 

with  a  left  coprime  matrix  fraction  description,  P(z,w)  =  D  ^(z,w)  N  (z,w)  is 

L  L 

stabilizable  by  means  of  a  causal  compensator  if  and  only  if  the  order 

_2 

mirrors  of  [D^  N^]  have  no  common  zeros  in  the  closed  unit  bidisc,  U 
The  2-D  setting  provides  a  nice  theoretical  framework  for  generalization  of 
these  stabilization  results  to  weakly  causal  systems.  Among  other  results,  it 
has  been  shown  that  many  causal  systems  which  are  not  stabilizable  by 
means  of  a  causal  compensator  can  be  stabilized  by  means  of  a  weakly  causal 
compensator.  (Here  stabilizable  is  meant  in  the  control  sense  -  i.e.  the 
feedback  system  is  stable).  In  fact  given  a  scalar  plant  with  d(0,0) 

t  0,  n(0,0)  =  0  one  can  achieve  a  structurally  stable  feedback  system  by 
means  of  a  causal  compensator  if  and  only  if  n(z,w)  and  d(z,w)  have  no  common 
zeroes  in  the  unit  bidisc,  whereas  if  one  allows  a  weakly  causal  compensator 
it  is  only  necessary  that  n(z,w)  and  d(z,w)  have  no  common  zeroes  on  the 
distinguished  boundary  of  the  unit  bidisc.  Similar  results  hold  in  the  multi¬ 
input/multi-output  or  multi-variable  case. 

10.  Explicit  conditions  required  to  be  satisfied  by  the  numerator  and  denominator 
polynomial  coefficients  of  a  magnitude-squared  rational  response  function, 

| S21 ( jwi »  jw2^ I  ♦  so  that  it  might  approximate  an  ideal  low-pass  characteristic 
along  any  straight  line  in  the  plane  through  (0,0)  in  a  maximally  flat  manner, 
have  been  obtained.  The  conditions  for  attenuation  along  all  radial  directions 
through  (0,0)  is  expressed  in  terms  of  a  positivity  of  a  form  in  two  variables. 

The  technique  is  easily  extended  to  the  multidimensional  case  and  can  be  used 
to  design  filters  other  than  those  of  the  low-pass  type.  The  theory  could 
be  used  to  design  lumped-distributed  and  variable-parameter  filters. 
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